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SIGNAL PROCESSING METHOD AND SIGNAL PROCESSING APPARATUS 
FTKT.D OF THE INVENTION 

The present invention relates to a signal processing method 
and a signal processing apparatus and, more particularly, to a 
process of dubbing digital video data or digital audio data. 

BACKGROUND OF THE INVENTION 

Conventionally/ dubbing of an MPEG (Moving Picture Experts 
Group) stream in which digital data such as motion video and 
audio are multiplexed (multiplexed coded data) is carried out 
while maintaining the form of the MPEG stream. 

The reason is as follows. For example/ when video data is 
coded by MPEG2 method while audio data is coded by MPEG1 method , 
the coded video data and the coded audio data are multiplexed as 
an MPEG stream for synchronization between these data. That is, 
the dubbing can be carried out at the highest efficiency when the 
coded video data and the coded audio data included in the MPEG 
stream are dubbed collectively as the MPEG stream. Another 
reason why the dubbing of the MPEG stream is conventionally 
carried out while maintaining the stream form is that there has 
been proposed no dubbing method other than such dubbing method. 

Figure 6 is a diagram for explaining the above-mentioned 
MPEG stream. 

With reference to figure 6, video data coded by MPEG2 method 
(coded video data) Dvc and audio data coded by AC 3 method (coded 
audio data) Dac are multiplexed as an MPEG stream Ds. Here, AC 3 



method is an audio coding method which is recommended in DVD 
(Digital Versatile Disk) video standards. Specifically, the MPEG 
stream Ds includes compressed video data Dvtc which is obtained 
by subjecting the coded video data Dvc to time-axis compression 
so that the data Dvc can be multiplexed with the coded audio data 
Dac, and compressed audio data Date which is obtained by 
subjecting the coded audio data Dac to time-axis compression so 
that the data Dac can be multiplexed with the coded video data 
Dvc* 

That is, the coded video data Dvc has such a data structure 
that it is divided in predetermined data units (GOP). For 
example, as shown in figure 6, the coded video data Dvc includes 
coded video data Dvcl corresponding to 1st to 16th video frames 
Fl to F16 constituting a first GOP (Group of Pictures), and coded 
video data Dvc2 corresponding to 17th to 32nd video frames F17 to 
F32 constituting a second GOP. Further, as shown in figure 6, 
the compressed video data Dvtc includes time-axis-compressed data 
VI to V3 corresponding to the first GOP, and time-axis -compressed 
data V4 to v6 corresponding to the second GOP * 

The time-axis-compreseed data V1 is obtained by performing 
time-axis compression on the forward part of the coded video data 
Dvcl corresponding to the first GOP collectively, the time-axis- 
compressed data V2 is obtained by performing time-axis 
compression on the middle part of the coded video data Dvcl 
collectively, and the time-axis -compressed data V3 is obtained by 



performing time-axis compression on the rearward part of the 
coded video data Dvcl collectively. Further, the time-axis- 
compressed data V4 is obtained by performing time-axis 
compression on the forward part of the coded video data Dvc2 
corresponding to the second GOP collectively , the time-axis- 
compressed data V5 is obtained by performing time-axis 
compression on the middle part of the coded video data Dvc2 
collectively, and the time-axis-compressed data V6 is obtained by 
-"performing tijne-axis compression on the rearward part of the 
coded video data Dvc2 collectively. 

Here, I data (intra-frame coded data) in the coded video 
data Dvcl corresponding to the first GOP corresponds to frame Fl, 
and P and B data (inter-frame coded data) corresponding to frames 
F2 to F16 are arranged subsequent to the I data corresponding to 
the frame Fl* I data (intra-frame coded data) in the coded video 
data Dvc2 corresponding to the second GOP corresponds to frame 
F17, and P and B data (inter-frame coded data) corresponding to 
frames J?'l8 to JV3 2 are arranged subsequent to the 1 data 
corresponding to the frame F17. 

Further, as shown in figure 6, the compressed audio data 
Date includes time- axis -compressed data Al to A3 corresponding to 
the first GOP, and time-axis -compressed data A4 to A6 
corresponding to the second GOP* 

The time-axis-compressed data Al , A2 and A3 are obtained by 
performing time-axis compression on parts of the coded audio data 



Dac, approximately corresponding to the time-axis-compressed data 
VI, V2 and V3 in the compressed video data Dvtc, respectively. 
Further, the time-axis-compressed data A4, A5 and A6 are obtained 
by performing time-axis compression on pax Is ol the coded audio 
data Dac, approximately corresponding to the time-axis-compressed 
data V4, V5 and V6 in the compressed video data Dvtc, 
respectively. 

Figure 7 is a block diagram for explaining a dubbing process 
using a conventional signal processing apparatus, and illustrates 
a DVD player and a DVD recorder as a conventional signal 
processing apparatus * 

initially, a description will be given of a dvd player 201 
as a conventional signal processing apparatus* 

The DVD player 201 includes a driving means 10 for driving 
an optical disk 1 as a first recording medium on the basis of a 
control signal Cdl, and a reading means 2 for reading data Ds 
from the optical disk 1 on the basis of a control signal Cro. On 
the optical disk 1/ coded video data and coded audio data, which 
are multiplexed, are recorded as an MPEG stream ds. As the MPEG 
stream, there are a transport stream (TS) and a program stream 
(PS), and in either stream, coded video data and coded audio data 
are time-axis-compressed and then multiplexed so that the both 
data can be played back in synchronization with each other. 

The DVD player 201 further includes a video decoding means 3 
and an audio decoding means 5. The video decoding means 3 
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receives the MPHG stream Ds read from the optical disk 1 , and 
decodes the coed video data which has been obtained by MPEG 2 
method and is included in the MPEG stream Ds to output a baseband 
(non-compressed) video signal Dvd. The audio decoding means 5 
receives the MPEG stream Ds read from the optical disk 1, and 
decodes the coded audio data which has been obtained by AC3 
method and is included in the MPEG stream Ds to output a baseband 
(non-compressed) PCM (Pulse-Code Modulation) audio signal Dad. 

The DVD player 201 further includes a D/A converter 11 for 
D/A-converting the baseband video signal Dvd outputted from the 
video decoding means 3 to output an analog video signal Sv; a TV 
monitor 12 for performing image display on the basis of the 
analog video signal Sv; a D/A converter 13 for D/A-converting the 
baseband audio signal Dad outputted from the audio decoding means 
5 to output an analog audio signal Sa; and a speaker 14 for 
outputting an audio output on the basis of the analog audio 
signal Sa* 

The DVD player 201 further includes a user's operation unit 
15; a control means 9 for outputting the control signals Cdl and 
Cro to the driving means 10 and the reading means 2, respectively, 
as well as control signals (not shown) to the other means 3 and 5 
and the D/A converters 11 and 13 on the basis of an operation 
signal Sopl generated in the operation unit 15; and output 
terminals 201a and 201b for outputting the analog video signal Sv 
and the analog audio signal Sa to the outside of the player, 



respectively. 

Next, a description will be given of a DVD recorder 2 02 as 
the conventional signal processing apparatus. 

The DVD recorder 202 includes input terminals 202a and 202b 
for receiving the analog video signal Sv and the analog audio 
signal Sa, respectively; an A/D converter 21 for converting the 
analog video signal Sv into a baseband digital video signal Dv; 
and an A/D converter 22 for converting the analog audio signal Sa 
into a baseband digital audio signal Da. 

The DVD recorder 202 further includes a video coding means 
23 for coding the baseband video signal Dv to output coded video 
data Dvc; and an audio coding means 24 for coding the baseband 
audio signal Da to output coded audio data Dac. 

The DVD recorder 202 further includes a driving means 27 for 
driving an optical disk 2 6 as a second recording medium on the 
basis of a control signal Cd2; and a recording means 25 for 
multiplexing the coded video data Dvc and the coded audio data 
Dac on the basis of a control signal Cre, and recording the 
multiplexed data as an MPEG stream Dw on the optical disk 26. 

The DVD recorder 2 02 further includes a user's operation 
unit 2 9; and a control means 28 for outputting the control 
signals Crc and Cd2 to the driving means 27 and the recording 
means 25, respectively, as well as control signals (not shown) to 
the other means 23 and 24 and the A/D converters 21 and 22 on the 
basis of an operation signal Sop2 generated in the operation unit 
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29. 

Next, a description will be given of the operation of the 
conventional signal processing apparatus. 

Initially, the operation of the DVD player 201 will be 
described. 

in the DVD player 201, when a process of playing back the 
data recorded on the optical disk 1 as the first recording medium 
is selected by user's operation, the respective means of the DVD 
player 201 perform the data playback process on the basis of the 
control signals from the control means 9. 

To be specific, initially, the optical disk 1 is driven by 
the driving means 10 that is controlled by the control signal Cdl, 
and the data Ds is read from the optical disk 1 by the reading 
means 2- The read data Ds is supplied from the reading means 2 
to the video decoding means 3 and to the audio decoding means 5 . 

More specifically, the video decoding means 3 and the audio 
decoding means 5 are supplied with, as the data Ds, an MPEG 
stream including MPEG2-coded video data and AC3 -coded audio data* 

Then, the video decoding means 3 performs a video decoding - 
process for extracting the MPEG2 -coded video data from the MPEG 
stream Ds and decoding the data, whereby a baseband video signal 
Dvd is generated. This video signal Dvd is outputted to the d/a 
converter 11. 

The d/A converter 11 performs a D/A conversion process for 
converting the video signal Dvd into an analog video signal Sv, 



and the analog video signal Sv is outputted to the TV monitor 12. 
The TV monitor 12 performs image display on the basis of the 
analog video signal Sv. 

Further, simultaneously with the above-mentioned playback of 
the coded video data, the audio decoding means 5 periorms an 
audio decoding process for extracting the AC3-coded audio data 
from the MPEG stream Ds and decoding the data, whereby a baseband 
PCM audio signal Dad is generated. This audio signal Dad is 
outputted to the D/A converter 13. 

The D/A converter 13 performs a D/A conversion process for 
converting the audio signal Dad into an analog audio signal Sa, 
and the analog audio signal Sa is outputted to the speaker 14. 
The speaker 14 periorms audio playback on the basis of the analog 

audio signal Sa. 

Further, during the above-mentioned playback of the coded 
video data and the coded audio data, the analog video signal Sv 
and the analog audio signal Sa are outputted to the output 
terminals 201 and 201b of the DVD player 201, respectively. 

Next, a description will be given of a dubbing process for 
recording the data recorded on the optical disk 1 as the first 
recording means, on the optical disk 26 as the second recording 
medium, by using the DVD player 201 and the DVD recorder 202. 

In advance of performing the dubbing process, the output 
terminals 201a and 201b of the DVD player 201 are connected to 
the corresponding input terminals 202a and 202b of the DVD 



recorder 2 02 , respectively. 

In the DVD player 201, when an operation signal Sopl is 
supplied from the user operation unit 15 to the control means 9, 
the control means 9 outputs control signals for controlling the 
respective parts. Further, in the DVD recorder 202, when an 
operation signal Sop2 is supplied from the user operation unit 29 
to the control means 28 , the control means 2 8 outputs control 
signals for controlling the respective parts. 

Then, in the DVD player 201, the playback of the MPEG stream 
recorded on the optical disk 1 is carried out. as described above, 
and the analog video signal Sv and the analog audio signal Sa 
obtained by the playback of the MPEG stream are outputted. On 
the other hand, in the DVD recorder 2 02, a recording process of 
subjecting the analog video signal Sv and the analog audio signal 
Sa outputted from the DVD player 201 to A/D conversion, coding 
and multiplexing, and recording data generated by the 
multiplexing is carried out* 

To be specific, in the DVD player 201, the MPEG stream 
recorded on the optical disk 1 is played back, and thus the 
analog video signal Sv and the analog audio signal Sa obtained by 
the playback of the MPEG stream are outputted from the output 
terminals 201a and 201b of the DVD player 201 to the input 
terminals 202a and 202b of the DVD recorder 202, respectively. 

in the DVD recorder 202, the analog video signal Sv inputted 
to the input terminal 202a is converted to a digital video signal 
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Dv by the A/'D converter 21, and supplied to the video coding 
means 23. On the other hand, the analog audio signal Sa inputted 
to the input terminal 202b is converted to a digital audio signal 
Da by the a/d converter 22, and supplied to the audio coding 
means 24. 

In the video coding means 23, coded video data Dvc is 
generated by coding the digital video signal Dv, and in the audio 
coding means} 24/ coded audio data Dac is generated by coding the 
digital audio signal Da, and then the coded video data Dvc and 
the coded audio data Dac are supplied to the recording means 25 • 

The coded video data Dvc and the coded audio data Dac are 
multiplexed ;and recorded on the optical disk 2 5 by the recording 
means 25. 

In this way, the dubbing process, i.e., recording of the 
MPEG stream recorded on the optical disk 1 as the first recording 
medium, on the optical disk 26 as the second recording medium, is 
carried out* 

By the way, in recent years, portable recording mediums such 
as semiconductor memories or the like are becoming widespread, . 
and there ma'y be cases where digital data such as motion video 
and audio aire dubbed on such portable recording mediums. 

in a dabbing process to the portable recording mediums such 
as semiconductor memories or the like, it is sometimes required 
that not the whole of the video data and audio data multiplexed 
as the MPEG stream but a part of the video data and audio data or 
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only one of the video data or the audio data is selectively 
recorded. 

In thife case, however, by the conventional technique of 

i 

dubbing the MPEG stream while maintaining the stream form, it is 
difficult to appropriately record only a part of the video data 
and audio data multiplexed as the MPEG stream or either the video 
data or the audio data. 

SHMMAWV OF ^JZ T^OTTON 

i 

The present invention is made to solve the above-described 
problems and has for its object to provide a signal processing 
method and at signal processing apparatus by which a desired part 
of audio data and video data which are multiplexed and recorded 
as an MPEG stream can be selected to be dubbed in accordance with 
a user's designation. 

According to a 1st aspect of the present invention f there is 
provided a signal processing method for reading data from a first 
recording mejdium on which multiplexed data obtained by 
multiplexing coded audio data and coded video data are recorded/ 
and recording the data on a second recording medium, comprising:- 
a reading step of reading the multiplexed data from the first 
recording medium; a decoding step of decoding at least one of the 
coded audio data and the coded video data which are included in 
the readout jmultiplexed data, to generate decoded data; a re- 
coding step pf re-coding the decoded data by a coding method 
i 

which is diflferent from a first coding method used in a coding 
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process of the coded audio data and a second coding method used 
in a coding process of the coded video data, to generate re-coded 
data; and a recording step of recording the re-coded data on the 
second recording medium. Therefore, a desired portion of audio 
data and video data which are multiplexed and recorded as an MPEG 
stream can selected and dubbed in accordance with the user's 
designation* 

According to a 2nd aspect of the present invention, in the 
signal processing method of the 1st aspect , the decoding step is 
a step of decoding at least part of the coded audio data included 
in the readout multiplexed data, to generate decoded audio data; 
and the re-coding step is a step of re-coding the decoded audio 
data by a third coding method which is different from the first 
coding method, to generate re-coded audio data as the re-coded 

i 

data. Therefore, coded audio data included in an MPEG stream or 
the like which is recorded on the first recording medium can be 
digitally dubbed, with changing its coding method into the 
optimum coding method for the second recording medium. 

According to a 3rd aspect of the present invention, in the - 
signal processing method of the 1st aspect, the decoding step is 
a step of decoding at least part of the coded video data included 
in the readout multiplexed data, to generate decoded video data; 
and the re-coding step is a step of re-coding the decoded video 
data by a foqrth coding method which is different from the second 
coding method, to generate re-coded video data as the re-coded 
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data. Therefore/ coded video data included in an MPEG stream or 
the like which is recorded on the first recording medium can be 
digitally dubbed, with changing its coding method into the 
optimum coding method for the second recording medium. 

According to a 4th aspect of the present invention, in the 
signal processing method of the 1st aspect, the decoding step is 
a step of decoding at least part of the coded video data included 
in the readout multiplexed data, to generate decoded video data; 
the re-coding step is a step of re-coding the decoded video data 

by a fourth coding method which is different from the second 

i 

coding method, to generate re-coded video data; and the recording 
step is a stjep of recording at least part of the coded audio data 
included in jthe readout multiplexed data and the re-coded video 
data on the second recording medium. Therefore, coded video data 
and coded audio data included in an MPEG stream or the like which 
is recorded on the first recording medium can be digitally dubbed, 
with changing only the coding method of the coded video data into 
the optimum coding method for the second recording medium. 

According to a 5th aspect of the present invention, in the . 
signal processing method of the 1st aspect, the decoding step is 
a step of decoding at least part of coded audio data included in 
the readout multiplexed data, to generate decoded audio data; the 
re-coding step is a step of re-coding the decoded audio data by a 
third coding; method which is different from the first coding 
method, to gfenerate re-coded audio data; and the recording step 
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is a step of recording at least part of the coded video data 
included in the readout multiplexed data and the re-coded audio 
data on the second recording medium- Therefore , coded video data 
and coded audio data included in an MPEG stream or the like which 
is recorded on the first recording medium can be digitally dubbed, 
with changing only the coding method of the coded audio data into 
the optimum <poding method for the second recording medium. 

According to a 6th aspect of the present invention, in the 

I 

¥signal processing method of the 1st aspect , the decoding step is 
pa step of decoding at least part of the coded audio data and at 
j¥ least part of the coded video data which are included in the 
*p readout multiplexed data, to generate decoded audio data and 
* decoded video data, respectively; the re-coding step is a step of 
y re-coding the decoded audio data by a third coding method which 
11 is different from the first coding method, to generate re-coded 
[T audio data, as well as re-coding the decoded video data by a 
fourth coding method which is different from the second coding 
method, to generate re-coded video data; and the recording step 
is a step of j recording the re-coded audio data and the re-coded - 
video data on the second recording medium. Therefore, coded 
video data and coded audio data included in an MPEG stream or the 
like which is recorded on the first recording medium can be 
digital dubbed, with changing the respective coding methods of 
the coded datja into the optimum coding methods for the second 
recording medium. 



According to a 7th aspect of the present invention , in the 
signal processing method of any of the 3rd, 4th and 6th aspects, 
the second cjoding method is MPEG method, and the fourth coding 
method is JPlEG method. Therefore, coded video data included in 
an MPEG streiam of the like which is recorded on the first 
recording mejdium can be digitally dubbed, with changing MPEG 
method as its coding method into JPEG method as the optimum 
coding met hop! for the second recording medium. 

According to an 8th aspect of the present invention, in the 
signal processing method of the 1st aspect, the coded video data 
is one which; is obtained by coding a video signal using MPEG 
method as the second coding method; the decoding step is a step 
of decoding at least a specific portion of the coded video data 
included in the readout multiplexed data, which portion 
corresponds jto one field or one frame, to generate decoded video 
data # as weip_ as decoding a prescribed amount of the coded audio 
data include^ in the readout multiplexed data, sequentially from 
a portion thereof relating to the specific portion, to generate 
decoded audip data; and the re-coding step is a step of re-coding 
at least park of the decoded video data by JPEG method to 
generate re-boded video data, as well as re-coding the decoded 
audio data by a third coding method which is different from the 
first coding' method to generate re-coded audio data- Therefore, 
a portion of coded video data included in an MPEG stream or the 
like being recorded on the first recording medium, which portion 



corresponds to one designated screen, can be digitally dubbed 

i 

together with coded audio data corresponding to plural screens 
relating to [the designated screen, with changing MPEG method as 
its coding mjethod of the coded video data into JPEG method as the 
optimum codilng method for the second recording medium. 

According to a 9th aspect of the present invention, there is 
provided a signal processing method for reading data from a first 

recording mejdium on which multiplexed data obtained by 

i 

multiplexing! coded audio data and coded video data are recorded, 
and recording the data on a second recording medium, comprising: 
a reading step of reading the multiplexed data from the first 
recording medium; a decoding step of decoding at least a specific 
portion of tjhe coded video data included in the readout 
multiplexed data, which portion corresponds to one field or one 
frame, to generate decoded video data 7 as well as decoding a 
prescribed apount of coded audio data included in the readout 
multiplexed jdata, sequentially from a portion thereof relating to 
the specific! portion, to generate decoded audio data; a re-coding 
step of re-cbding at least part of the decoded video data by JPEG 
method which is different from MPEG method used in a coding 
process of the coded video data, to generate re-coded video data, 
as well as rje-coding the decoded audio data by a third coding 
method which,' is different from a first coding method used in a 
coding method of the coded audio data, to generate re-coded audio 
data; and a recording step of recording the re-coded video data 



and the re-coded audio data on the second recording medium. 
Therefore, a portion of coded video data included in an MPEG 
stream or the like recorded on the first recording medium, which 
portion corresponds to one designated screen, can be digitally 
dubbed together with coded audio data corresponding to plural 
screens relating to the designated screen, with changing MPEG 
method as the coding method of the coded video data into JPEG 
method as the optimum coding method for the second recording 
.i medium. 

According to a 10th aspect of the present invention, there 
j is provided a signal processing method for reading data from a 
- first recording medium on which multiplexed data obtained by 

multiplexing coded audio data and coded video data are recorded, 
jand recording the data on a second recording medium, comprising: 
1 a reading step of reading the multiplexed data from the first 
1 recording medium; a decoding step of decoding at least part of 
the coded video data included in the readout multiplexed data, to 
generate decoded video data; a conversion step of subjecting the 
decoded video data to a resolution conversion process for 
thinning out pixel values or a conversion process for converting 
a data format^, to generate converted video data; a re-coding step 

i 

of re-coding jthe converted video data to generate re-coded video 
data; and a recording step of recording the re-coded video data 
on the second recording medium. Therefore, when coded video data 
is to be dubtjed, the coded video data which is recorded on the 
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first recording medium can be recorded on the second recording 

i 

medium/ with) converting resolution or signal format thereof. 

i 

According to an 11th aspect of the present invention, there 
is provided la signal processing apparatus for reading data from a 
first recording medium on which multiplexed data obtained by 

multiplexing coded audio data and coded video data are recorded, 

i 

and recording the data on a second recording medium/ comprising: 
a reading unit for reading the multiplexed data from the first 
recording medium; a decoder for decoding at least one of the 
coded audio data and the coded video data which are included in 
the readout multiplexed data, and outputting decoded data; a re- 
encoder for ire-coding the decoded data by a coding method which 
is different from a first coding method used in a coding process 

of the coded audio data and a second coding method used in a 

i 

coding process of the coded video data, and outputting re-coded 
data; and a 'recording unit for recording the re-coded data on the 
second recording medium. Therefore, a desired portion of audio 

data and vi4eo data which are multiplexed and recorded as an MPEG 

i 

stream can be selected and dubbed in accordance with the user's - 
designation- 

According to a 12th aspect of the present invention/ there 
is provided a signal processing apparatus for reading data from a 
first recording medium on which multiplexed data obtained by 

multiplexing coded audio data and coded video data are recorded, 

! 

and recording the data on a second recording medium, comprising: 
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a reading unit for reading the multiplexed data from the first 
recording medium; a video decoder for decoding at least a 
specific portion of the coded video data included in the readout 
multiplexed data/ which portion corresponds to one field or one 
frame, and outputting decoded video data; an audio decoder for 
decoding a prescribed amount of the coded audio data included in 
the readout multiplexed data, sequentially from a portion thereof 
relating to the specific portion, and outputting decoded audio 
if data; a video encoder for re-coding at least part of the decoded 
m video data JPEG method which is different from MPEG method 
iy used in a coding process of the coded video data, and outputting 
«S re-coded vid£o data; an audio encoder for re-coding the decoded 
* audio data b^r a third coding method which is different from a 
\J first coding | method used in a coding process of the coded audio 
ffl data, to generate re-coded audio data; and a recording unit for 
recording the re-coded video data and the re-coded audio data on 
the second recording medium. Therefore/ a portion of coded video 
data included in an MPEG stream or the like which is recorded on 
the first recording medium, which portion corresponds to one 

designated screen, can be digitally dubbed together with coded 

t 

audio data corresponding to plural screens relating to the 
designated screen, with changing MPEG method as the coding method 
of the coded! video data into JPEG method as the optimum coding 
method for tlae second recording medium. 

According to a 13th aspect of the present invention, there 



is provided a signal processing apparatus for reading data from a 
first recording medium on which multiplexed data obtained by 
multiplexing coded audio data and coded video data are recorded, 
and recording the data on a second recording medium, comprising: 
a reading unit for reading the multiplexed data from the first 
recording medium; a video decoder for decoding at least part of 
the coded video data included in the readout multiplexed data, to 
generate decoded video data; a data converter for subjecting the 
decoded video data to a resolution conversion process for 

thinning out| pixel values or a conversion process for converting 

i 

a data format, to generate converted video data; an encoder for 
re-coding the converted video data to generate re-coded video 
data; and a recording unit for recording the re-coded video data 
on the second recording medium. Therefore, when coded video data 
is to be dubbed, the coded video data recorded on the first 
recording medium can be recorded on the second recording medium, 
with converting resolution or signal format thereof. 
BRIEF DESCRIPTION OF THE DRAWINGS 

Figure |l is a block diagram for explaining a signal 
processing apparatus according to a first embodiment of the 
present invention. 

Figure |2 is a diagram for explaining signal processing by 
the signal pfcocessing apparatus according to the first embodiment. 

Figure '3 is a block diagram for explaining a signal 
processing apparatus according to a second embodiment of the 
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present invention . 

Figure 4 is a block diagram for explaining a signal 
processing apparatus according to a third embodiment of the 
present invention- 

Figure i5 is a block diagram for explaining a signal 
processing apparatus according to a fourth embodiment of the 
present invejnt ion . 

Figure 6 is a schematic diagram for explaining a data 



structure of 



an MPEG stream which is dubbed by a conventional 



signal processing apparatus. 

Figure 7 is a block diagram for explaining a conventional 
signal processing apparatus, 

DKTATT.-ED nKfifcRTPTTOM OF THE PREFERRED EMBODIMENTS 



[Embodiment 1] 

Figure 1 is a block diagram for explaining a signal 
processing apparatus 101 according to a first embodiment of the 
present invejnt ion* 

The sijjnal processing apparatus 101 of this first embodiment 
is one for processing AV (audio video) data. 

More specifically, the signal processing apparatus 101 
includes a c^riving means 10 for driving an optical disk 1 as a 
first recording medium; and a reading means 2 for reading data Ds 
from the optical disk 1* On the optical disk 1, an MPEG stream 
is recorded as the data Ds. As the MPEG stream, there are a 
transport stjream (TS) and a program stream (PS), and in either 



stream, coded video data and coded audio data are time-axis- 
compressed and multiplexed so that the both data can be played 
back in synchronization with each other. 

The signal processing apparatus 101 further includes a video 
decoding means 3 and an audio decoding means 5 . The video 
decoding meahs 3 receives the data (MPEG stream) Ds read from the 
optical disk 1 by the reading means 2, and decodes the coded 
video data, which has been obtained by MPEG2 method and is 



included in 



the MPEG stream Ds, to output a baseband video signal 



Dvd. The au|dio decoding means 5 receives the MPEG stream Ds read 

from the optlical disk 1, and decodes the coded audio data, which 

i 

has been obtained by AC 3 method and is included in the MPEG 
stream Ds, to output a baseband PCM audio signal Dad. 

The signal processing apparatus 101 further includes a video 
coding means 4 and an audio coding means 6* The video coding 
means 4 receives the baseband video signal Dvd, and encodes a 
portion of tjhe baseband video signal Dvd, which portion is 
designated bjy a control signal Cvc, to output re-coded video data 
Dvrc. The aiudio coding means 6 receives the baseband audio 
signal Dad, and encodes a portion of the baseband audio signal 
Dad, which portion is designated by a control signal Cac, to 
output re-colded audio data Dare. 

The signal processing apparatus 101 further includes a 

recording mejans 7 and a control means 9a. The recording means 7 

I 

records the Ire-coded video data Dvrc outputted from the video 



coding means 4 and the re-coded audio data Dare outputted from 
the audio coding means 6, on a memory card 8 as a second 
recording medium, on the basis of a control signal Cre. The 
control means 9a generates the control signals Cvc, Cac, Cre and 
the like forj controlling the respective means as mentioned above, 

on the basis! o£ an operation signal Sop generated by user's 

i 

operation, j 

I 

The recording means 7 has a multiplexing unit (not shown) 
for time-axifS-compreesing the re-coded video data from the video 
coding means 4 and the re-coded audio data Dare from the audio 
coding meand 6 and multiplexing these compressed data, and the 
recording me^ans 7 records the multiplexed re-coded video data and 
re-coded aucjlio data, as AV multiplexed data dw, on the memory 
card 8. It' is not required that the recording means 7 should 
multiplex the re-coded video data and the re-coded audio data, 
and it may Record the re-coded video data and the re-coded audio 

data in the! corresponding areas of the memory card 8, 

i 

respectively . 

I 

Furth4^/ the control signal Cvc supplied to the video coding 

i 

means 4 designates a portion to be re-coded of the baseband video 
signal Dvd, and the control signal Cac supplied to the audio 
coding meanjs 6 designates a portion to be re-coded of the 
baseband audio signal Dad. In figure 1, control signals 
outputted ^rorn the control means 9a to the driving means 10, the 
reading medns 2, and the recording means 7 are not shown. 



Further, the video coding means 4 encodes a portion of the 
baseband video signal Dvd, which portion corresponds to one 
designated frame/ by JPEG (Joint Photographic Coding Experts 
Group) method that is a coding method different from MPEG2 * 
Further, the audio coding means 6 encodes the baseband audio 
signal Dad, over several frames relating to the video 
corresponding to the designated frame, by AAC (Advanced Audio 
Coding) method that is an audio coding method suited to the 

memory card[ 8 . 

I 
i 

The signal processing apparatus 101 further includes a D/A 
converter 11 for D/A-converting the baseband video signal Dvd 
outputted Jrom the video decoding means 3 to output an analog 
video signal Sv; a TV monitor 12 for performing image display on 
the basis of the analog video signal Sv; a D/A converter 13 for 
D/A-converting the baseband audio signal Dad outputted from the 
audio decoding means 5 to output an analog audio signal Sa; and a 

speaker 14 for performing audio output on the basis of the analog 

i 

audio signjal Sa, 

! 

The peading means 2, the video decoding means 3, the audio 
decoding xiieans 5, the video coding means 4, the audio coding 
means 6, the recording means 7, the control means 9a, and the D/A 
converters 11 and 13, which are constituents of the signal 
processing apparatus 101 of the first embodiment, may be 
implemented by hardware or software* In this first embodiment, 
these constituents are implemented by software. 
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Next, the operation of the signal processing apparatus 101 
will be described- 
Figure 2 is a diagram for explaining the MPEG stream 
recorded on the optical disk 1 and the multiplexed re-coded data 
Dw to be recorded on the memory card 8, In figure 2, coded video 
data Dvc, compressed video data Dvtc, coded audio data Dac, 
compressed audio data Date, and an MPEG stream Ds are identical 
to those shown in figure 6. 

In the signal processing apparatus 101 of this first 
embodiment , when an operation signal Sop indicating execution of 
a process for dubbing the data recorded on the optical disk 1 
(the first recording medium) on the memory card 8 (the second 
recording rjiedium) is outputted from the user operation unit 15 to 
the control means 9a by user's operation, the respective means of 
the signal processing apparatus 101 perform the dubbing process 
on the basis of the control signals from the control means 9a. 
In the signal processing apparatus 101 of the first embodiment, 
as a process for playing back the data recorded on the optical 
disk 1, a jprocess which is identical to the data playback process 
performed 'by the conventional DVD player 201 shown in figure 7 is 
carried out* 

That is, initially, the optical disk 1 is driven by the 

driving m£ans 10 , the data Ds is read from the optical disk 1 by 

i 

the readihg means 2, and the read data Ds is supplied to the 
video decoding means 3 and to the audio decoding means 5. 



To be specific, the video decoding means 3 and the audio 
decoding means 5 are supplied with; as the data Ds, an MPEG 
stream including MPEG2~coded video data and AC3~coded audio data, 

Then r the video decoding means 3 performs a video decoding 
process for extracting the MPEG2-coded video data Devc from the 

MPEG stream Ds and decoding the data, whereby a baseband digital 

i 

video signal Dvd is generated. This digital video signal Dvd is 

i 

outputted t£> the D/A converter 11 and the video coding means 4. 
In thi D/A converter 11, the digital video signal Dvd is 

converted into an analog video signal Sv by D/A conversion, and 

i 

the analog jvidea signal Sv is outputted to the TV monitor 12 * 
The TV monitor 12 performs image display on the basis of the 
analog video signal sv. 

The Video coding means 4 performs, on the basis of the 
control signal Cvc from the control means 9a, a re-coding process 
for coding a portion of the baseband digital video signal Dvd, 

which portion is designated by the control signal cvc. For 

j 

example , 3s the re-coding process, the video coding means 4 

! 

performs d process for coding the digital video signal Dvd 

i 

corresponding to one frame image, which frame is selected by the 
user, by irPEG method to generate re-coded video data Dvrc« 

The audio decoding means 5 performs an audio decoding 
process for extracting the AC3-coded audio data Deac from the 
MPEG stream Ds and decoding the data, whereby a baseband PCM 
digital a,udio signal Dad is generated- This digital audio signal 
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Dad is outpujtted to the D/A converter 13 and the audio coding 

i 

means 6* 

In the D/A converter 13, the digital audio signal Dad is 
converted into an analog audio signal Sa by D/A conversion, and 
the analog audio signal Sa is outputted to the speaker 14. The 
speaker 14 performs audio playback on the basis of the analog 
audio signajL Sa. 

The audio coding means 6 performs, on the basis of the 
control signal Cac from the control means 9a, a re-coding process 
for coding a portion of the baseband digital audio signal Dad, 
which portion is designated by the control signal Cac. For 
example, the audio coding means 6 performs a process for coding 

the audio Signal Dad, sequentially over several frames from one 

i 

video frames selected by the user, which frames relate to the 
iinage of the selected video frame, by AAC method to generate re- 
coded audio data Dare. The audio coding means 6 may encode the 
audio signal Dad by MP 3 (MPEG1 audio layer3) method, not by the 
AAC method. 

The Ire-coded video data Dvrc which is generated by the video 
coding means 4 and the re-coded audio data Dare which is 
generated by the audio coding means 6 are supplied to the 
recording means 7 . The re-coded video data Dvrc and the re-coded 
audio datia Dare are multiplexed and recorded on the memory card 8 
as the second recording medium by the recording means 7. 

Hereinafter, the user's data designation method in the 



2* 



above-mentioned dubbing process and the data recorded on the 
memory card 8 in accordance with the user's designation are more 
specifically described* 

When an image which the user wants to record (for example/ 
image of the 1st frame Fl) is displayed on the TV monitor 12, the 
user performs a prescribed recording operation. Then, the 

control means 9a generates the control signals Cvc and cac to the 

i 

video coding means 4 and the audio coding means 6, on the basis 
U of an operation signal generated by that operation, and supplies 
CI the control 1 signals to the respective means. 

fj Then, the video coding means 4 performs a process for coding 

42 only a vid^o signal SI corresponding to the 1st frame PI, which 

s ' has been inputted as the baseband video signal Dvd, and outputs 

PI ' i 

y re-coded video data Jl corresponding to the video signal of one 
5 frame to the recording means 7 . 

J Further, at this time, the audio coding means 6 performs a 

re-coding process for coding an audio signal Bal corresponding to 
video signals of several frames from the frame which has been 
subjected! to the above-mentioned coding process, for example, 

frames Flj to F8, and outputs re-coded audio data PI which has 

i 

been obtained by that re-coding process to the recording means 7* 

I 

Then, the recording means 7 correlates the re-coded video 
data Jl of the image of one frame with the re-coded audio data Pi 
corresponding thereto so that these data are played back in 
synchronization with each other, and records these data on the 
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memory card 8. 

When the image of the 9th frame F9 is displayed and then the 
user perforins a prescribed recording operation/ a video signal S9 
of the baseband video signal Dvd, corresponding to the 9th frame, 
is coded, and for example an audio signal Ba2 corresponding to 
the 9th to 18th frames is coded as the baseband audio signal Dad 
relating to the 9th frame, as shown in figure 2. Then, re-coded 
video data fr9 of the 9th frame and re-coded audio data P2 of the 
9th to 18th frames are outputted to the recording means 7. 

In thus first embodiment, even when the above-mentioned 
recording operation is performed, the TV monitor 12 and the 

perform playback of video and audio corresponding to 
frames successively* 
As described above, the signal processing apparatus 101 of 
the first embodiment includes the reading means 2 for reading an 
MPEG stream Ds recorded on the optical disk 1 (first recording 

medium) ; the video decoding means 3 for decoding MPEG2-coded 

I 

video data] included in the read MPEG stream Ds; and the audio 
decoding tyeans 5 for decoding AAC-coded audio data included in 
the read ijiPEG stream, and re-codes decoded video data 
corresponding to the image of a frame designated by user's 
operationj and decoded audio data corresponding thereto, by JPEG 
method an|l AAC (or MP3) method, respectively, to record the coded 
data on the memory card 8 as the second recording medium* 
Therefore, coded video data and coded audio data of a specific 



speaker 14 
respective 



:J0 

portion of the MPEG stream Ds which is recorded on the optical 
disk 1 can be dubbed with changing their coding methods. 
Consequently, while watching a still picture of one designated 
frame, the user can listen sound relating to that picture over 
several frames, by playing back coded video data and coded audio 
data which are recorded on the memory card 8. 

In this first embodiment, the descriptions have been given 
of the case where coded video data of one frame designated by the 
^user (for example, data which is obtained by re-coding decoded 
Svideo data by JPEG method) and coded audio data over several 
^frames relating to the video data are recorded, while coded audio 
Wjdata which is recorded together with the coded video data of one 
O frame is not [restricted to the coded audio data over several 
O frames relating to the coded video data of one frame, 
flj For example, coded audio data over several minutes can be 

P recorded as the coded audio data relating to the coded video data 

Li. 

'"of one frame designated by the user. In addition, coded audio 
data corresponding to one piece of music having the length of 
approximately 1 , three to five minutes can be recorded entirely as 
the coded audio data relating to one frame. 

Further, in this first embodiment, descriptions have been 
given of the case where coded video data of one frame designated 
by the user ajid coded audio data relating thereto over several 
frames are recorded. However, when the baseband video signal is 
an interlaced signal, coded video data of one field designated by 
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the user and coded audio data relating thereto over several 
fields may be recorded. 

In this first embodiment, while the signal processing 
apparatus records coded video data corresponding to the image of 
one frame designated by the user (i.e., still picture) and coded 
audio data relating thereto over several frames, the signal 
processing apparatus may record coded video data corresponding to 
images of several frames designated by the user (i.e., moving 
Clpictures) an4 coded audio data relating thereto. 

Q For example, in the signal processing apparatus, as shown in 

JKfigure 2, when the user designates the 20th to 25th frames F20 to 
SF25, the recording means 7 can multiplex coded video data Ml 
^Uwhich is obtained by coding video signals S2 0 to S25 



^corresponding 



to these frames by MPEG1 method, and coded audio 



5data CI whichj is obtained by coding an audio signal Ba3 
^corresponding to the frames F20 to F2 5 by AAC method, and record 
multiplexed dlata on the memory card 8* In this signal processing 

apparatus, wh^n the user designates the 26th to 31st frames F26 

i 

to F31, the recording means 7 multiplexes coded video data M2 

i 

which is obtained by coding video signals S2 6 to S31 
corresponding: to these frames by MPEG1 method, and coded audio 
data C2 which! is obtained by coding an audio signal Ba4 
corresponding: to the frames F26 to F31 by AAC method, and records 
multiplexed data on the memory card 8. 

Further, in this first embodiment, the signal processing 



apparatus is 'provided with the D/A converter 11 for D/A- 
converting a baseband video signal to output an analog video 
signal; the TV monitor 12 for receiving the analog video signal 
as an input signal; the D/A converter 13 for D/A-converting a 
baseband audio signal to output an analog audio signal; and the 
speaker 14 for receiving the analog audio signal as an input 
signal, to monitor decoded video and audio signals- However, it 
is unnecessary to monitor both of the decoded video signal and 
audio signal. 

For example, the signal processing apparatus may be provided 
with only the d/a converter 11 and the TV monitor 12, among the 

D/A converters 11 and 13, the TV monitor 12 and the speaker 14/ 

i 

thereby monitjoring only the decoded video signal. 

Further, in this first embodiment, when an MPEG stream 

i 

recorded on t-he first recording medium is to be dubbed, the 
signal processing apparatus re-codes and records both of coded 

video data anjd coded audio data included in the MPEG stream. 

i 

However/ as tjhe dubbing process to the mpeg stream, the signal 
processing apparatus may perform a process for re-coding one of - 
the coded vidleo data and the coded audio data and recording the 
other of these data as it is without being re-coded. 

In the signal processing apparatus of this first embodiment, 
when the codep video data Jl corresponding to frame Fl and the 

coded audio d|ata Pi corresponding to frames Fl to F8 are to be 

i 

recorded, the! TV monitor 12 sequentially displays images of the 
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respective frames subsequent to frame F1 . However, in this 
signal processing apparatus, the TV monitor 12 may keep the 
display of the image corresponding to frame Fl designated by the 
user for a prescribed period (for example for 5 seconds) on the 
basis of the control signal from the control means 9a, and 
thereafter sequentially display images of respective frames 
subsequent to frame F2. 

Further, in this first embodiment, the process for recording 
^.the coded video data Jl of frame Fl and the coded audio data Bal 

a? 
ssj. 

iof frames Fl 



patching the 



to F8 is carried out in real time while the user is 
image display on the TV monitor 12. However, the 
] process for rjecording a video signal of a frame designated by the 
3 user and an abdio signal of several frames corresponding thereto 
Imay be carried out by designating a portion desired by the user 
jwith using thp time of playback or the like, after moving 
1 pictures of one image sequence have been all watched. 

[Embodiment 2] 

Figure 3 is a block diagram for explaining a signal 
processing apparatus 102 according to a second embodiment of the 
present invention - 

This signal processing apparatus 102 of the second 
embodiment includes, in place of the audio decoding means 5 and 
the audio coding means 6 in the signal processing apparatus 101 
of the first embodiment, an audio data extraction means 15 for 
extracting cojaed audio data Dac from an MPEG stream Ds read from 



the optical disk 1 and outputting the coded audio data Dac to the 
recording means 7; and an audio decoding means 5a for receiving 
the MPEG stream DS, extracting coded audio data Dac included in 
the stream, decoding the coded audio data Dac, and outputting 
decoded audio data Dad to the D/A converter 13. A control means 
9b in the signal processing apparatus 102 of the second 
embodiment is different from the control means 9a of the first 
embodiment only in that it outputs a control signal Cae to the 
audio data extraction means 16, in place of the control signal 

i 

Cac to the aujdio coding means 6 in the first embodiment* 

Other parts of the signal processing apparatus 102 of the 
Second embodiment are identical to those in the signal processing 
1 apparatus lOlj of the first embodiment. 

Next, tiie operation of the signal processing apparatus 102 
I will be described* 

When a process for dubbing data recorded on the optical disk 
1 {first recording medium) on the memory card 8 (second recording 
medium) is commanded by user's operation, the signal processing 
apparatus 102 records coded video data and coded audio data which - 
are designated by the user's operation, on the memory card 8 as 
the second recording medium. 

In the signal processing apparatus 102 of this second 

embodiment, a' process for playing back data recorded on the 

i 
i 

optical disk jl is identical to that, in the signal processing 
apparatus lOljof the first embodiment. 



Hereina 



fter, a dubbing process in this second embodiment: 



will be described. 



In the 



signal processing apparatus 102, on the basis of the 
control signals from the control means 9b, an MPEG stream Ds is 
read from the optical disk 1/ and coded video data and coded 
audio data w^ich are included in the MPEG stream Ds are decoded 
by the video decoding means 3 and the audio decoding means 5a, 
respectively- Then, decoded video data Dvd and decoded audio 
data Dad are D/A-converted by the D/A converter 11 and 13, 
respectively, and an analog video signal Sv and an analog audio 
signal sa are outputted to the TV monitor 12 and the speaker 14, 
respectively . 

The video coding means 4 performs, on the basis of the 
control signal Cvc from the control means 9b, a re-coding process 
for coding a jportion of the baseband video signal Dvd, which 
portion is designated by the control signal Cvc, to output re- 
coded video data Dvrc which is obtained by that re-coding process, 
to the recording means 7. The audio data extraction means 16 
performs, on the basis of the control signal Cae from the control 
means 9b, a process for extracting a portion of the MPEG stream 
Ds, which portion is designated by the control signal Cae, to 

i 

output extracted coded audio data Dac to the recording means 7. 

I 

The re-^oded video data Dvrc which has been generated by the 
video coding fneans 4 and the coded audio data Dac which has been 
extracted by the audio data extraction means 15 are recorded by 



th<=> recording means 7 on the memory card 8 as the second 
recording medium- 

To be more specific, in the signal processing apparatus 102 
of this second embodiment, the coded video data recorded on the 
first recording medium (optical disk) 1 are recorded on the 
second recording medium (memory card) 8 with changing its coding 
method from MPEG to JPEG, while the coded audio data recorded on 
the first recording medium (optical disk) 1 are recorded on the 

^memory card 8 as it is in an AC3-coded state, without changing 

Jjits coding method. 

£t as described above, the signal processing apparatus 102 of 

^Othis second embodiment includes the reading means 2 for readinq 
Can MPEG streatn Ds recorded on the optical disk 1 (first recording 
©medium); the video decoding means 3 for decoding MPEG2 -coded 
fU video data included in the read MPEG stream; and the audio data 
□extraction means 15 for extracting AC3-coded audio data from the 
read MPEG stream, and re-codes decoded video data corresponding 
to the image 6f a frame designated by user's operation, by JPEG 
method to record re-coded data on the memory card 8 as the second- 
recording medium, as well as records coded audio data 
corresponding to the image of the designated frame included in 
the MPEG stream as it is on the memory card 8. Therefore, when 
the MPEG stream is to be dubbed, it is possible to record coded 
video data wi:h changing its coding method, and record coded 
audio data without carrying out its re-coding process- 



Consequently, data processing required for re-coding of coded 
audio data in the dubbing process can be reduced. 

In the signal processing apparatus 102 of this second 
embodiment, when data recorded on the optical disk 1 is dubbed on 
the memory card 8, coded video data and coded audio data are both 
recorded on the memory card 8. However, it is possible to record 
only coded video data on the memory card 8. 
[ Embodiment 3 ] 

p Figure p is a block diagram for explaining a signal 

yg processing apparatus 103 according to a third embodiment of the 

p i present invention . 

|i The signal processing apparatus 103 of this third embodiment 

^ includes/ in place of the video decoding means 3 and the video 
H coding means 4 in the signal processing apparatus 101 of the 
IU first embodiment, a video data extraction means 17 for extracting 
CI coded video cjata Dvc from an MPEG stream Ds read from the optical 
disk 1, and dutputting the data to the recording means 7; and a 
video decodir^g means 3a for receiving the MPEG stream Ds, 
extracting coded video data Dvc included in the stream, decoding _ 
the coded video data Dvc, and outputting decoded video data Dvd 
to the D/A converter 11- Further, a control means 9c in the 
signal processing apparatus 103 of the third embodiment is 
different frcm the control means 9a of the first embodiment only 
in that it oiitputs a control signal Cve to the video data 
extraction m^ans 17, in place of the control signal Cvc to the 
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video coding means 4 of the first embodiment. 

Other parts of the signal processing apparatus 103 of the 
third embodiment are identical to those in the signal processing 
apparatus 101 of the first embodiment. 

Next, the operation of the signal processing apparatus 103 
will be described. 

When a process for dubbing data recorded on the optical disk 
1 (first recording medium) on the memory card 8 (second recording 
Gbedium) is commanded by user's operation, the signal processing 
Apparatus 103 records coded video data and coded audio data which 

I E 

fl&re designated by the user's operation on the memory card 8 as 

•jgthe second recording medium. 

O 

, In the signal processing apparatus 103 of this third 

Q 

Embodiment , a process for playing back data recorded on the 
|iJoptical disk 1 is identical to that in the signal processing 
rf apparatus 101 of the first embodiment. 

Hereinafter, a dubbing process in this third embodiment will 
be described. 

In this signal processing apparatus 103, on the basis of the 

control signajls from the control means 9c, an MPEG stream Ds is 

i 

read from the! optical disk 1, and then coded video data and coded 



audio data wh 
by the video 
respectively. 



ich are included in the MPEG stream Ds are decoded 
decoding means 3a and the audio decoding means 5, 
Then, decoded video data Dvd and decode audio data 



Dad are D/A«c|Dnverted by the D/A converters 11 and 13/ 
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respectively, and an analog video signal Sv and an analog audio 
signal Sa are outputted to the TV monitor 12 and the speaker 14, 



respectively j 
At this 
basis of the 



time, the audio coding means 6 performs, on the 
control signal Cac from the control means 9c, a re- 
coding procesls lor coding a portion of the baseband audio signal 

Dad, which portion is designated by the control signal Cac, and 

i 

outputs coded audio data Dare which is obtained by that re-coding 
process, to tjhe recording means 7. Further, the video data 
extraction m^ans 17 performs, on the basis of the control signal 
Cve from the control means 9c, a process for extracting a portion 
of the MPEG stream Ds, which portion is designated by the control 
signal Cve, and outputs extracted coded video data Dvc to the 
recording means 7. 

ie re-coded audio data Dare which has been generated 
coding means 6 and the coded video data Dvc which 
has been extracted by the video data extraction means 17 are 
recorded by tjhe recording means 7 on the memory card 8 as the 
second recording medium* 

To be more specific, in the signal processing apparatus 103 

of this thirc^ embodiment, coded audio data recorded on the first 

i 

recording medium (optical disk) 1 are recorded on the second 
recording medium (memory card) 8 with changing its coding method 
from AC 3 to AAC, while coded video data recorded on the first 
recording medium (optical disk) 1 are recorded on the memory card 



Then, t 
by the audio 
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fi as it is in a MPEG2-coded state, without changing its coding 
method. For example, data of moving pictures (plural frames) 
corresponding to a designated portion of an MPEG stream or data 
of a still picture (one Irame) can be recorded on the memory card 
8. When data of one frame is to be recorded on the memory card 8, 
it is desirable that the frame to be recorded should be an intra- 

frame coded frame - 

As described above, the signal processing apparatus 103 of 
Othis third embodiment includes the reading means 2 for reading an 
if! MPEG stream DS recorded on the optical disk 1 as the first 

3 s 

Ci recording medium; the audio decoding means 5 for extracting AC3- 

coded audio c^ata from the read MPEG stream and decoding the 
y extracted datja; and the video data extraction means 17 for 
H extracting MPEG2 -coded video data from the read MPEG stream, and 
W re-codes decoded audio data corresponding to the image of a frame 
O designated by user's operation, by AAC method to record re-coded 

data on the memory card 8 as the second recording medium, as well 

i 

as records copied video data corresponding to the image of a 
designated frame included in the MPEG stream as it is on the 

memory card 8j, Therefore, when the MPEG stream is to be dubbed, 

! 

it is possiblje to record coded audio data with changing its 
coding method, and record coded video data without performing its 

re-coding process. Consequently, signal processing required for 

i 

re-coding of the coded audio data in the dubbing process can be 
reduced . 
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In the Signal processing apparatus 103 of this third 
embodiment, when data recorded on the optical disk 1 are to be 
dubbed on thi memory card 8, coded video data and coded audio 
data are both recorded on the memory card 8. However, it is also 
possible to record only coded audio data on the memory card 8. 

[Embodiment 4] 

Figure 5 is a block diagram for explaining a signal 

processing apparatus 104 according to a fourth embodiment of the 

i 

jpresent invenjtion. 

i The sighal processing apparatus 104 of the fourth embodiment 

\ includes a resolution conversion means 18 between the video 
: decoding means 3 and the video coding means 4 in the signal 
^processing apparatus 101 of the first embodiment. The resolution 
^conversion mejans 18 subjects decoded video data Dvd outputted 
* from the video decoding means 3 to resolution conversion, on the 
i basis of a control signal Cre, and outputs video data Drc 
obtained by the resolution conversion, to the video coding means 
4. A controlj means 9d in this fourth embodiment is different 
from the control means 9a of the first embodiment only in that it 
generates the control signal Crc to the resolution conversion 
means 18. 

More specifically, the resolution conversion means 18 
subjects decoded video data Dvd outputted from the video decoding 
means 3 to a process for thinning out pixels constituting one 
frame, thereby converting the resolution or signal format of the 



decoded vide4 data Dvd. For example, the resolution conversion 
means 18 performs a process for thinning out pixel values 
constituting video data of one frame so that the number of pixels 
in one frame in the horizontal direction is reduced to one-half, 
one-third, or two-thirds the original number, or the number of 
pixels in one frame in the vertical direction is reduced to one- 
half the origlinal number or the like. This resolution conversion 
means 18 can performs a process for thinning out pixel values 
□constituting video data of one frame so that the numbers of 
Spixels in one frame in the horizontal direction and vertical 

^direction are) reduced at a prescribed ratio, thereby converting a 

m I 

~Phd (High Definition) signal of HD or the like into a standard 
^signal of SD (Standard Definition) or the like. 
H The signal processing apparatus 104 of this fourth 

0! embodiment further includes, in place of the memory card 8 as the 
Q second recording medium in the first embodiment, an optical disk 
la and a driving means 10a for driving the optical disk la. The 
optical disk la as a second recording medium can be either a disk 
different froiu or the same as the optical disk 1 as the first 

recording medium - 

i 

Other parts in the signal processing apparatus 104 of the 
fourth embodiment are identical to those in the signal processing 
apparatus 101! of the first embodiment. 

Next, the operation of the signal processing apparatus 104 
will be described. 



The operation of the signal processing apparatus 104 of the 

fourth embodiment is different from the operation of the signal 

i 

processing apparatus 101 of the first embodiment only in that 

i 

decoded videc} data Dvd outputted from the video decoding means 3 
is subjected to resolution conversion and then resolution- 
converted data is outputted to the video coding means 4 • 

i 

! 

To be mpre specific, when an MPEG stream Ds read from the 

i 

optical disk jl is inputted to the video decoding means 3, the 
video decoding means 3 performs a decoding process for extracting 
coded video data which has been obtained by MPEG2 method from the 
MPEG stream, |and decoding the extracted coded video data. A 
baseband video signal Dvd which has been obtained by that 

decoding process is supplied to the D/A converter 11 and the 

i 

resolution conversion means 18. The video signal Dvd supplied to 

the D/A convejrter 11 is converted into an analog signal and 

! 

outputted to Jthe TV monitor 12. 

On the cj>ther hand, the resolution conversion means 18, on 
the basis of the control signal Cre from the control means 9d, 
subjects the inputted video signal Dvd to a process for thinning - 
out pixel valjues of video data corresponding to one frame so that 

the number of I pixels in video of one frame in the horizontal 

J 

direction or jvertical direction is reduced, and outputs 
resolution-converted video data Drc whose resolution or signal 
format has been converted, to the video coding means 4* 

Then, as in the first embodiment, the video coding means 4 



AA 

performs , on *the basis of the control signal Cvc from the control 
means 9d, a re-coding process for coding a portion corresponding 
to a frame in the resolution-converted video data Drc 
corresponding to the MPEG stream, which irame is designated by 
the control signal Cvc, by a determined coding method. Here, the 
coding method in the re-coding process may be either MPEG which 
is the same as the coding method of coded video data included in 
the MPEG stream which is recorded on the optical disk 1 , or JPEG 

flvhich is different from that of coded video data included in the 

yy MPEG stream. 

fi\ Further, coded audio data included in the MPEG stream Ds 

j^which is readj from the optical disk 1 is subjected to a decoding 
^process by thfe audio decoding means 5 as in the first embodiment. 
Ha baseband audio signal Dad which has been obtained by the 

decoding procbss is supplied to the D/A converter 13 and the 
0 audio coding jneans 6. The audio signal Dad supplied to the d/a 

converter 13 jis converted into an analog signal, and outputted to 

i 

the speaker 14. The audio coding means 6 performs, on the basis 
of the control signal Cac from the control means 9d, a re-coding - 
process for coding a portion corresponding to a frame in the 
decoded audioj data (i.e., baseband audio signal) Dad 
corresponding to the MPEG stream, which frame is designated by 
the control signal, by a determined coding method. 

When decoded audio data is to be re-coded, it is possible to 

j 

employ either! a coding method which is different from that of 
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coded audio data which is recorded on the first recording medium 
as described in the first embodiment, or a coding method which is 
the same as jihat of coded audio data which is recorded on the 
first recording medium as described in the second embodiment. 

Then, tlhe coded video data Dvc and the coded audio data Dac 
which have been obtained by the re-coding processes are inputted 
to the recording means 7, and recorded by the recording means 7 
on the optical disk la as the second recording medium. 

As described above, the signal processing apparatus 104 of 
this fourth embodiment includes the reading means 2 for reading 
an MPEG stream ds recorded on the optical disk 1 as the first 
recording medium; the video decoding means 3 for decoding MPEG2- 
coded video !data included in the read MPEG stream; the audio 
decoding me^ns 5 for decoding AAC-coded audio data included in 
the read MP^G stream; and the resolution conversion means 18 for 
subjecting encoded video data Dvd outputted from the video 
decoding means 3 to resolution conversion, and re-codes video 
data Drc wh^ch has been obtained by the resolution conversion to 
record the ^e-coded data on a recording medium, Therefore, when 
coded video data is to be dubbed, the coded video data recorded 
on the first recording medium can be recorded on the second 
recording medium, with changing the resolution or signal format 
of the data. 

In th^s fourth embodiment, in the resolution conversion 
process to Video data, only the process for thinning out pixel 



values const ijtuting image data of one frame (screen) so that the 
number of pixels in one frame in the horizontal direction or 
vertical direction is reduced at a prescribed ratio is carried 

out* Howeve^:, in the resolution conversion process to video data, 

i 

it is possible to thin out pixel values corresponding to 

! 
i 

insignificant pixels in one screen, and select only pixel values 
corresponding to a partial area of one screen (frame), in this 
case, only video data corresponding to a designated area in one 
screen can b& re-coded. 

In any of the aforementioned embodiments, the MPEG stream is 
a transport stream (TS), a program stream (PS) and the like, but 

! 

the MPEG strjeam is not restricted to these streams* 

Furthe^:, in any of the aforementioned embodiments, the MPEG 
coding methdd of coded video data which is recorded on the first 

recording medium as an MPEG stream is MPEG2, while the MPEG 

j 

coding methcid can be MPEG1, MPEG4, MPEG7 or the like. 

In anyj of the aforementioned embodiments/ the coding method 
of coded auc}lio data which is recorded on the first recording 
medium as ap MPEG stream is AC3, but the coding method of coded 
audio data jLs not restricted to AC 3 and can be, for example, an 
audio coding method conforming to MPEG1 or MPEG2 , AAC, or PCM. 

In any of the aforementioned embodiment, the coding method 
which is used for re-coding audio data is AAC, but this coding 

method is nlot restricted to AAC, For example, the coding method 

i 

can be an dudio coding method conforming to MPEGl or MPEG2, PCM 



or the like, jas long as it is different from the coding method of 

i 

coded audio ejata recorded on the first recording medium (fox- 
example AC 3 ) 

i 
i 

In any the aforementioned embodiment, the coding method 
which is used for re-coding video data is JPEG, but this coding 
method is not; restricted to JPEG. For example, the coding method 
can be H.261,j H.263, Wavelet or the like, as long as it is 
different from the coding method of coded video data recorded on 
the first recording medium (for example MPEG2 ) * 

Further, in any of the aforementioned embodiment, the first 
recording medium is an optical disk, but the first recording 
medium is not restricted to an optical disk and can be a hard 
disk, a magneto-optical disk, a magnetic disk, a semiconductor 

memory, or a | magnetic tape, 

i 

Further, in any of the first to third embodiments/ the 
second recording medium is a memory card 8 as a semiconductor 
memory, but jthe second recording medium is not restricted to the 

i 

memory card jand can be, for example, a hard disk, an optical disk, 

! 

a magneto-optical disk/ a magnetic disk, or a magnetic tape* 

Further, in any of the aforementioned embodiments, the first 

recording medium and the second recording medium are separate 

recording mediums, while these recording mediums can be one 

recording medium* 

Further, in any of the first to fourth embodiments, coded 

video data ajnd coded audio data which are recorded on the first 
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recording medium are both recorded on the second recording medium, 
while only orie of coded video data and coded audio data can be 
recorded on the second recording medium. 



